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ABSTRACT 

This  paper  research  on  handwritten  character  recognition.  For  character  recognition  to  achieve  the  better  accuracy 
is  important.  By  using  the  neural  network  and  feature  extraction  the  recognition  is  achieved.  Before  lots  of  work  has  done 
on  English  character  relatively  less  work  has  done  in  Kannada  character.  This  paper  proposes  the  HCR  using  English, 
Kannada  &  Digit  characters  by  using  four,  eight,  twelve  directional  feature  extraction  techniques  and  comparing  in  detail 
with  gradient  extractions  values. 
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1.  INTRODUCTION 

Character  recognition  is  definitely  the  application  area  where  it  is  becoming  more  and  more  important  in  modern 
world.  To  recognize  the  handwritten  character  is  the  difficult  task  for  the  computers  so  that  researchers  have  been  involved 
in  handwritten  character  recognition. 

Handwritten  character  recognition  is  not  new  technology  because  there  are  lots  of  difficult  methods  are  developed 
for  recognizes  the  characters  but  the  goal  of  the  system  is  to  achieve  good  accuracy  because  human  beings  are  not  able  to 
recognize  every  handwritten  character  without  any  vocabulary  text. 

There  are  several  techniques  for  recognition  the  characters  among  this  neural  network  is  the  made  their  first 
significance  contribution  in  engineering  [7]  [8].  By  using  the  back  propagation  neural  network  recognition  accuracy  is 
achieve  [1].  This  paper  proposes  the  lot  of  work  has  done  in  English  characters  relatively  less  work  has  done  in  Kannada 
characters.  In  this  paper  describing  the  recognition  of  English,  Indian  script  language  Kannada  and  digit  character  also  detail 
comparison  on  the  four,  eight,  and  twelve  directional  feature  extraction  techniques.  In  this  paper  initially  gradients  feature 
extracting  from  the  normalization  image  using  sobel  and  Gaussian  mask  technique.  And  after  that  feature  is  extracted  with 
the  different  directional  feature  extraction  using  gradients  in  this  paper  the  results  are  experimenting  on  matlab  and  the 
results  are  comparing  on  four,  eight,  and  twelve  directional  techniques  which  one  is  having  better  accuracy. 

2.  LITERATURE  REVIEW 

In  this  paper  it  describes  review  of  the  techniques  before  used  in  the  previous  papers.  By  online  and  offline 
characters  recognition  is  the  method  for  the  optically  sensed  document  text  to  translate  in  human  readable  characters  to 
machine  readable  code  with  this  it  achieve  95%  accuracy  [11].  Lot  of  work  has  done  in  feature  extraction  technique  each 
pixel  is  extracted  and  achieved  high  accuracy  [3].  In  this  paper  it  describes  higher  resolution  on  both  magnitude  and  angle  of 
the  directional  strokes  in  character  image  [4]. The  effect  of  stroke  direction  caused  by  shape  normalized-cooperated  gradient 
feature  extraction  provide  higher  recognition  [12].  In  [13]  developed  directional  feature  extraction  technique  it  gives  the 
character  which  normalized  it  takes  the  each  character  in  specific  direction  and  achieve  accuracy  rate.  In  achieving  better 
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accuracy  modified  quadratic  extraction  technique  has  developed  with  95.42%  accuracy  [14].  These  papers  proposed  only  for 
feature  extraction  for  character  recognition  for  using  the  real  application  the  system  should  be  in  adaptable  and  recognition 
rate  should  be  more  for  this  case  the  system  is  use  called  neural  network  [7]  [8]  [9].  In  this  network  the  feed  forward  back 
propagation  neural  network  is  achieve  fastest  recognition  rate  with  the  training  time  98.12%  [1][6][15].  Neural  network 
describes  adaptive  character  recognition  feature  extraction  [10][15]. 

From  this  above  literature  review  it  describes  the  feature  extraction  and  neural  back  propagation  technique  which  is 
used  for  recognition.  This  system  is  proposes  for  describing  the  different  directional  technique  and  compare  in  detail  using 
the  characters.  In  this  section  describes  the  database  for  character,  section  III  describes  system  model,  section  IV  feature 
extraction  technique,  and  section  V  describes  Back  propagation  neural  technique  with  multi  perceptron  neural  network 
VI  conclusion. 

3.  SYSTEM  MODEL 
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Figure  1:  Character  Reorganization  Model 


3.1  Database 


In  this  paper  database  are  using  for  English,  Kannada,  and  digits.  Each  character  is  having  10  samples  (A-Z),  (0-9). 
This  database  is  having  the  variations  in  shape,  different  size,  thickness.  This  database  is  used  for  neural  network  for  training 
and  testing  the  data. 

3.2  Preprocessing 
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Figure  2:  Preprocessing  Model 

The  preprocessing  performing  important  role  in  pattern  recognition  for  matching  the  character  and  the  pattern 
should  be  in  distortion  less  Character.  In  this  method  the  raw  data  and  brings  into  the  specific  format  for  recognize  the 
character  fastly. 
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It  consist  of 

3.2.1  Binarization 

In  the  pattern  matching  if  the  image  or  pattern  in  the  grey  scale  then  this  image  or  character  is  converted  into  the 
binary  image  (black  and  white)  by  using  the  global  image  threshold.  So  that  recognize  the  character  in  to  black  and  white 
colour  is  become  easy  and  it  increases  the  accuracy. 

3.2.2  Skeletonization 

The  Skeletonization  is  the  process  of  removing  unwanted  pixel.  It  perform  thinning,  remove  the  trunk  of  character 
by  using  spurring  and  brings  into  standardize  size.  Skeletonization  is  obtain  from  geometrical  and  topological  property. 


Figure  3:  Thinning 


Figure  4:  Spurring 


Figure  5:  Topology  Method 


3.2.3  Noise  Removing 


In  this  technique  it  removes  the  noise  which  present  in  character.  This  noise  is  obtained  from  the  electronic 
instrument  like  optical  scanning  device,  writing  instrument.  Noise  can  remove  by  image  processing  method  like  filtering 
method. 


Figure  6:  Noise  Removing  Method 

3.2.4  Normalization 

The  normalization  is  the  part  of  preprocessing  where  It  converts  the  random  character  into  the  standard  or  specific 
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size.  It  consist  fragmentation.  Fragmentation  it  reduce  s  the  un-necessary  part  of  the  character  where  it  has  two  types 
horizontal  and  vertical  fragmentation. 

3.2.4.1  Horizontal  Fragmentation-  It  Removes  the  Upper  and  Bottom  Un-  Necessary  Part 


Figure  7:  Horizontal  Fragmentation 
3.2.4.1  Vertical  Fragmentation-  It  Removes  the  Left  and  Right  Un-Necessary  Part 
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Figure  8:  Vertical  Fragmentation 


4.  FEATURE  EXTRACTION 


Feature  extraction  is  used  for  pattern  recognition  and  data  analysis.  Feature  extraction  has  many  different 
techniques  to  extract  the  feature  for  recognition  .This  reduce  computational  requirement  which  is  based  on  two  types  of 
features. 

4.1  Stastical 

It  distribution  of  pixel  in  terms  of  stastical. 

4.2  Structural 

This  features  based  on  topological  and  geometrical  property.  This  paper  propose  the  three  feature  extraction 
method  for  character  recognition 

4.3  Conventional  Feature  Extraction 

In  conventional  method  for  each  pixel  it  has  horizontal  and  vertical  border.  In  that  case  if  a  line  passes  through  a 
pixel  then  corresponding  pixel  will  be  given  value  (1)  or  (0)  but  it  takes  lot  of  time  to  extracting  the  character. 

4.4  Gradient  Feature  Extraction 

It  has  sobel  operator  which  applies  the  result  on  image  point  which  depends  on  the  colour  of  intensity.  The  gradient 
of  two  variable  functions  where  the  each  image  point  describes  by  intensity  of  the  image  if  it  has  constant  image  then  the 
image  intensity  is  zero  if  it  has  on  edge  vector  then  it  has  higher  values  . 

To  extend  the  gradient  feature,  3*3  sobel  operator  are  used  to  the  gradient  components  in  horizontal  and  vertical 
direction  respectively. 
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Figure  9:  Horizontal  Mask  and  Vertical  Mask 

Gx=gy  (i  j)  =  f  ( i-  1,  j  +1)  +  2f  (i,  j+1  )+  f  (i+1,  j+1) 

-f(i-l,j-l)-2f(i,j-l)-f(i+l,j-l)  (1) 

Gy=  gy  (ij)  =  f  ( i- 1,  j  -l)  +  2f  (i-i,  j )+  f  (i-i,  j+i) 

-f(i+l,j-l)-2f(i+l,j)-f(i+l,j+l)  (2) 

grad  =  Gy/Gx  =  tan-1  [gh  ( i.j)  /  gy(ij) 

4.5  Directional  Feature  Extraction 

This  technique  is  used  recognize  the  characters,  after  normalizing  the  character  image  into  standard  size.  Each  pixel 
applies  directional  planes  with  each  recording  the  local  stroke  components  in  a  specific  direction.  This  technique  applies  on 
the  gradient  by  using  the  sobel  mask  operator  to  recognize  the  character  directionally.  This  paper  describes  the  four. 
Eight  and  twelve  directional  Directional  comparing  in  detail  in  terms  of  classification  time,  Training  time 

4.5.1  For  Four  Directional 


Figure  10:  Graphical  Representation  of  Four  Directional 
Table  1:  Gradient  Values  for  Four  Directional 


4.5.2  For  Eight  Directional 


Gradient  Values 

Direction 

g  =  -l 

0 

o  <  g  <  n/2 

1 

n/2  <  g  <  n 

2 

n  <  g  <  3  n/2 

3 

3  n/2  <  g  <  2YI 

4 

Figure  11:  Graphical  Representation  of  Eight  Directional 
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Table  2:  Gradient  Values  for  Four  Directional 


Gradient  Values 

Directions 

g  =  -l 

0 

o  <  g  <  n/4 

1 

n/4  <  g  <  n/2 

2 

n/2  <  g  <  3n/4 

3 

3n/4  <  g  <  n 

4 

n  <  g  <  5n/4 

5 

5n/4<g<3IT/2 

6 

3IT/2  <  g  <  7YI/2 

7 

7W2  <  g  <  2YI 

8 

4.5.3  For  Twelve  Directional 


Figure  12:  Graphical  Representation  of  Twelve  Directions 
Table  3:  Gradient  Values  for  Four  Directional 


Gradient  Values 

Directions 

g  =  -l 

0 

o  <  g  <  n/6 

1 

n/6  <  g  <  n/3 

2 

n/3  <  g  <  n/2 

3 

n/2  <  g  <  n 

4 

n  <  g  <  2n/3 

5 

2n/3<g<5n/6 

6 

5n/6  <  g  <  n 

7 

n  <  g  <  7n/6 

8 

7n/6<g<4n/3 

9 

3n/3  <  g  <  5n/2 

10 

5n/3<g<  im/6 

11 

l  m/6  <  g  <  2  n 
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This  result  shows  the  directional  pattern  values,  using  the  gradient  extraction  technique  for  each  pixel. 

5.  BACK  PROPAGATION  NEURAL  NETWORK 

Back  propagation  neural  network  is  used  for  recognition  system  [10]  [13]  In  Back  propagation  the  recognition  task 
take  place  with  in  less  time  for  that  purpose  system  we  to  be  trained  by  using  database. 

Back  propagation  is  a  systematic  method  for  training  multi-layer  artificial  neural  networks.  The  multilayer  has  no. 

of.  inputs  Al,  A2  An  are  called  association  units  and  their  task  is  to  extract  specific,  localized  featured  from  the  input 

images  this  model  name  as  multilayer  perceptron  neural  network  MPLN  with  some  additional,  fixed,  pre-processing. 
Perceptrons  mimic  the  basic  idea  behind  the  visual  system.  They  were  mainly  used  in  pattern  recognition  even  though  their 
capabilities  extended  a  lot  more.  [8]  [9]. 

Backward  propagation  of  errors  is  a  common  method  of  training  neural  networks.  Back  propagation  is  a 
systematic  method  for  training  multi-layer  artificial  neural  networks.  It  is  a  multi-layer  forward  network  using  extend 
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gradient-descent  based  delta  learning  rule.  Back  propagation  provides  a  computationally  efficient  method  for  changing  the 
weights  in  feed  forward  network.  The  aim  of  this  network  is  to  train  the  net  to  achieve  a  balance  between  the  input  and 
output  with  provide  good  responses  to  the  similar  [10] 


Input  Hidden  Output 

layer  layer  layer 

Figure  13 

Learning  in  Back  Propagation 

There  are  two  types  of  rule, 

5.1  Sequential  Rule  or  Pre  Pattern  Rule 

This  rule  is  used  for  free  parameter  and  pattern  classification  for  real  applications. 

5.2  Batch  Learning  and  Pre-Epoch  Method 

This  rule  used  for  time  period  basis  which  has  entire  training  set  it  is  used  for  nonlinear  regression. 

6.  EXPERIMENTING  AND  ANALYSIS 

This  system  proposes  experiment  on  32*32  Kannada  and  English  characters  and  digits  character  and  comparing  the 
result  on  four,  eight,  and  twelve  types  of  directions.  In  this  paper  the  parameter  will  be  observing  are 

Table  4:  Experimenting  and  Analysis  Parameters 

32*32Input  characters 
(Trad.,Gradient,4,8,12  directional) 
Input  to  single  layerd  or  MPLN 
No.  of  hidden  layers 
Training  time 

Testing  time  

Recognition  rate 

Performance  on  accuracy  

7.  CONCLUSIONS 

This  paper  proposes  about  of  directional  feature  extraction  using  the  back  propagation  neural  network.  Before  this 
work  carried  by  using  twelve  direction  on  English  character  depending  upon  the  four,  eight  and  twelve  directions  without 
using  neural  network  This  paper  is  propose  for  Kannada,  English  and  digits  characters  by  using  4,8,12  directions  and 
comparing  the  results  using  neural  network 
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